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Abstract 

This work considers the quadratic Gaussian multiterminal (MT) source coding problem and provides 
a new sufficient condition for the Berger-Tung sum-rate bound to be tight. The converse proof utilizes a 
set of virtual remote sources given which the MT sources are block independent with a maximum block 
size of two. The given MT source coding problem is then related to a set of two-terminal problems with 
matrix-distortion constraints, for which a new lower bound on the sum-rate is given. Finally, a convex 
optimization problem is formulated and a sufficient condition derived for the optimal BT scheme to satisfy 
the subgradient based Karush-Kuhn-Tucker condition. The set of sum-rate tightness problems defined by 
our new sufficient condition subsumes all previously known tight cases, and opens new direction for a 
more general partial solution. 
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I. Introduction 

Multiterminal (MT) source coding, which was introduced by Berger |[fl and Tung ||2l in 1977, defines 
the problem of separate compression and joint decompression of multiple correlated sources subject to 
distortion constraints. Finding the achievable rate region for the general MT problem is very hard, hence 
research has been focusing on the quadratic Gaussian case when the sources are jointly Gaussian and 
the distortion measure is the mean-squared error. The sum-rate part of the achievable rate region of the 
quadratic Gaussian MT problem is of particular interest and has been characterized for several special 
instances. 

By connecting the quadratic Gaussian MT source coding problem to the quadratic Gaussian CEO 
problem (3J, S, Wagner et al. Q showed sum-rate tightness of the Berger-Tung (BT) rate region for 
the two-terminal and positive-symmettic cases. Wang et al. then provided an alternative proof based 
on an estimation-theoretic result, which also leads to a sufficient condition for BT sum-rate tightness. 
Yang and Xiong started with a generalized quadratic Gaussian CEO problem and proved sum-rate 
tightness in the bi-eigen equal-variance with equal distortion (BEEV-ED) case. Although the BEEV-ED 
case satisfies the sufficient condition given in 0, the proof technique for the converse theorem is different 
and examples more explicit. 

Wang et a/.'s sufficient condition is so far the most inclusive condition for BT sum-rate tightness, 
and its converse proof consists of the following steps. First, a set of L virtual sources, referred to as 
the remote sources, were constructed such that the given L MT sources can be viewed as independently 
Gaussian corrupted versions of the remote sources. Then, they used an estimation-theoretic result in 
conjunction with the semidefinite partial ordering of the distortion matrices to give a lower bound on the 
MT sum-rate. Finally, an optimization problem was formulated to find the best lower bound over possible 
(conditional and unconditional) distortion matrices, with the Karush-Kuhn-Tucker (KKT) condition given 
and simplified to prove their main result. An important assumption that enables their proof is that the 
observation noises between the virtual remote sources and the MT sources are independent Gaussian 
with a diagonal covariance matrix. Since the rate-distortion function for independent Gaussian random 
sources is completely known, this assumption dramatically simplifies the lower bound and hence the 
optimization problem. 

In this paper, we provide a new and more inclusive sufficient condition than Wang et aVs for 
BT sum-rate tightness 1 . The main novelty is to consider a larger set of remote sources, such that the 

'The conference version of this work appeared in |[8j. 
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observation noises between the MT and remote sources have a block-diagonal covariance matrix, instead 
of a diagonal matrix as assumed in |6j. By restricting the noise covariance matrix to have K 2 x 2 
diagonal blocks and (L — 2K) lxl diagonal blocks, we build a connection between the L-terminal 
problem and K two-terminal problems with matrix-distortion constraint. 

Unfortunately, although the original quadratic Gaussian two-terminal source coding problem with 
individual distortion constraint has been completely solved O, 0, the exact minimum sum-rate for 
its variant with a matrix-distortion constraint is still unknown in general. A composite lower bound is 
already provided by Wagner et al. 0. We partially improve the composite lower bound in this paper, 
using a technique inspired by Wang et al.'s work |6]. It is shown that this improvement can be infinitely 
large in some extreme cases. However, our new lower bound does not always match the BT upper bound, 
leaving a bounded gap between them. 

Our new lower bound for the matrix-distortion constrained two-terminal problem is then utilized to 
give a new sum-rate lower bound on the L-terminal problem. After forming an optimization problem to 
search for the best L-terminal lower bound, we characterize the generalized KKT condition based on the 
subgradient iflOl of the objective function, which is convex, continuous, but non-differentiable. Finally, 
our new sufficient condition is obtained by simplifying the subgradient-based KKT condition. Examples 
with tight sum-rate bound are also given. 

The set of sum-rate tightness problems defined by our new sufficient condition subsumes all previously 
known tight cases, including Wagner et al. 's positive-symmetric case, Wang et al. 's sufficient condition, 
and Yang and Xiong's BEEV-ED case, thanks to the following two novelties. First, replacing Wang et 
al.'s independence assumption on the observation noises with a block-independent one leads to a larger 
repertoire of remote sources that serve as the basic tools for deriving the sum-rate lower bound. Second, 
the partially improved composite bound for the matrix-distortion constrained two-terminal problem gives 
a wider range of subgradients, hence a more relaxed subgradient-based KKT condition. 

It is worth noting that, our new condition even includes degraded cases where the target distortions are 
not simultaneously achieved in the optimal BT scheme. This is the first time a degraded case is proved 
to have a tight BT sum-rate bound. 

In addition, the technique introduced in this paper might be further generalized to allow 3 x 3 (or 
even larger) block size in the observation noise covariance matrix to yield even more new tight cases, if 
one can explicitly give a lower-bound on the corresponding matrix-distortion constrained three-terminal 
problem. 

The rest of this paper is organized as follows. Section II gives the formal definition of the quadratic 
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Gaussian MT source coding problem and reviews existing results on sum-rate tightness. Section III studies 
the two-terminal source coding problem with matrix-distortion constraint, and provides an improved lower 
bound on the sum-rate. Section IV states our main results on a new sufficient condition for sum-rate 
tightness, and presents a degraded example belonging to the block-degraded case that satisfies our new 
condition. Section V gives a simplified sufficient condition for the sum-rate tightness in the non-degraded 
cases, followed by two additional examples satisfying the simplified condition. Section VI concludes the 
paper. 

II. The quadratic Gaussian MT source coding problem and existing results on 

SUM-RATE TIGHTNESS 

A. The quadratic Gaussian MT source coding problem 

For any integer L, denote C = {1, 2, L}. Let Yc = (Y±, Y2, Yi) T be a length-L vector Gaussian 
source with mean and covariance matrix Sy c . Also denote Y$ k as the length- |<Sfc| subvector of Yjr 
indexed by S^. For an integer n, let Yc = {Xc,ii Xc,2, •••> Xc,n) be an Lxn matrix with Yc,u i = 1,2, n 
being n independent drawings of Yc- Also denote Ys k as the |<S&| x n submatrix of Yc with column 
indices Sk- For any Lxn random matrix Yc and any random object to, define the conditional covariance 
matrix of Yc given uj as 

cov(r £ |w) = -e[(Yc-E(Yc\uj))(Yc-E(Yc\uj)) T ]. (1) 

Consider the task of separately compressing a length-n block of sources Yc at L encoders and 
jointly reconstructing Yc as Yc at a central decoder subject to individual distortion constraints Dc = 
{Di, D2, Dl}. This problem is known as the quadratic Gaussian MT source coding problem, whose 
block diagram is depicted in Fig Q] 

Let 



^3 

be the j-th encoder function and 



(n) •R»->{i,2 ) ...,2 fl 5 n) -1}, je£ (2) 



^S n) : {1, 2, 2^"' - 1} x {1, 2, 2 R * n) - 1} x ... x {1, 2, 2 R ? - 1} ^ M. n (3) 



be the reconstruction function for Yj. Denote Wj as the transmitted symbol at the j-th encoder, and 
Rsumi'Pc ' ^i™^ ) = Sj6£ Rj as tne sum-rate of the MT coding scheme (4>c > r£^ )■ ^ e sa y a rate tu pl e 



September 13, 2010 



DRAFT 



5 



Y 1 

^- 




1 w 1 

► 


Joint 
Decoder 

>• 


1 An 


Pnpnrlpr 1 




► 


A n 
Y 


Y n 




1 

Encoder i 


► 




► 

A n 


Yl 




Encoder L 


► 


► 


► 



Fig. 1. The quadratic Gaussian MT source coding problem. 



...,Rl) t is (£y £ , D/;) -achievable if there exists a sequence of schemes {{4>^\ ip^) '■ n e 
such that 

(n) 

limsupi?:- < Rj, for any j £ C, (4) 

n— >oo 

limsup —E (Yj t i — Yj t i) 2 < Dj, for any j £ C. (5) 

n— >oo Tl L 

Define the (Xy. , Dc) -achievable rate region Ks Y£ (Ac) as the convex closure of all (Xy £ , Dc) -achievable 
rate tuples, i.e., 

KvvjPc) = C K (Ri,R 2 ,...,R L ) T ■■(Ri,R2,---,R L ) T is (S y ,£> £ ) achievable}. (6) 
The minimum sum-rate with respect to (£y c ,Z)£) is then defined as 

L 

i^GDc) = inf{ ^i? l :( J R 1 ,^ 2 ,...,^ L ) T G^ £ ( J D £ )}. (7) 
i=l 

Berger and Tung JT], provide an mrcer rate region inside which all rate tuples are (Y1y c ,Dc)- 
achievable. In this paper, we restrict ourselves to a subset of the Berger-Tung inner rate region inside 
which all points can be achieved by parallel Gaussian test channels. This subset is referred to as the 
Berger-Tung (BT) inner rate region in the sequel. Let U c = (U\, U2, ■ ■ ■ , Ul) T be a length-L auxiliary 
random vector such that 

• Ui = Yi + Qi, i = 1, 2, . . . , L, where Qi ~ A/"(0, Oq .), and all Qj's are independent of each other 
and of all Y^'s, 
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. U c satisfies eI (Y; - E{Yi\U c )f\ < A for alH = 1, 2, . . . , L, 
and define ZY(£y c , Ac) as the set of all auxiliary random vectors Uc that satisfy the above conditions. 
Then the following lemma gives the BT inner rate region, the proof can be found in HI, El . 

Lemma 1: Define 



ni T (Dc) 



U {(R 1 ,R ! i,...,R L ) T :J2^i> i(Ya;U a \u C -a)}: 

U c eU(Z Yc ,Dc) 



then 



In particular, the BT minimum sum-rate 



RfJ m (Z Y „D c ) = ini{ ^R, : (R 1 ,R 2 ,...,R L f GTZ^(D C )} 



i=l 



inf 



log 2 



satisfies 



(8) 



(9) 



(10) 



fisum(Sy £ ,£*/;) < # s «m( S Y,c> Ac) 



(ID 



where denotes the set of all L x L positive definite (p.d.) diagonal matrices. 

For example, the BT rate region for the quadratic Gaussian two-terminal source coding problem with 



a 



Yi 



pay 1 &y 2 



(7t 



is given by 



Kil c (D c ) = K? T (D 1 ,D 2 ) n ftf (A, A) n Kw (D 1 ,D 2 ), 



,BT 



BT I 



t BT / 



(12) 



where 



TZf T (D 1 ,D 2 ) = {(R 1 ,R 2 ):R i >^log + [(l-p 2 + p 2 2- 2R >y-£-]},i,j = l,2,i^j, (13) 



ftf 2 T (A,A) = {(R 1 ,R 2 ):R l + R 2 >=-log + [(l-p 



1 



O 2 2 

2 v Pmax &Yi ®Yo 



]}• 



(14) 



2 o lv r , 2AA 

with /3 max = 1 + */l+ n 4P 2\^ 1 ? 2 -i » and log + x = maxjlog x, 0}. The BT rate region with er£ = 
CT 2. = 1, p = 0.9, and Ac = (0.1,0.1) T is shown in Fig. E where <97tf T (A, A) and <97tf 2 T (A, A 
are the boundaries of 7£f T (A, A) and lZi 2 (D\, D 2 ), respectively. 
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B. Existing results on sum-rate tightness 

Wagner et al. [5 ] proved that for the two-terminal case (with L = 2), the BT minimum sum-rate is 
equal to the MT minimum sum-rate, i.e., 

R sum (Z Y „D c ) = RfJ m (Z Y „D c ) (15) 

for any 2x2 positive semidefinite (p.s.d.) symmetric matrix T>y c and length-2 positive vector They 
also showed tightness of the BT sum-rate bound for the positive symmetric case, i.e., (031 ) holds for any 
L x L positive-symmetric matrices of the form 

a b b ... b 
b a b ... b 



Sy c = S L (a,b) 



(16) 



b b b ... a 

for some a > b > and any Dc = (D, D, D) T for some D > 0. 

The most general cases of quadratic Gaussian MT source coding problem with tight sum-rate are 
provided by Wang et al. (6j. Their proof contains four major steps. 
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First, the L MT sources Yc are connected to L remote sources Xc such that 

Y c = Xc + Nc 



(17) 



with Nc being a zero-mean Gaussian vector independent of Xc with a diagonal covariance matrix 






<4i 











Nl 



(18) 



Then they use the Markov chain Xc — > Yc — > Wc to obtain an estimation-theoretic result that 
cov(Y c\X c,Wc) must also be diagonal. 

Exploit the semidefinite partial order of the distortion matrices, which is due to the fact that a linear 
minimum mean squared error (MMSE) estimator cannot outperform its optimal MMSE counterpart, 
to show that 

-l 



cov(Yc\Xc,Wc) d ({cav(y c \Wc)) 1 + - 



• A lower bound on the MT minimum sum-rate i? Sy (Ac) is derived by exploiting the diagonal 
structure of cov(Y c\X c, Wc)- 

• Form a convex optimization problem that minimizes the above lower bound over D = cov(Y c \Wc) 
and 7£ = di&g(cov(Y c\X c,Wc)^J , and establish a sufficient condition for the D and 7£ that 
correspond to the optimal BT scheme to satisfy the the KKT condition of the optimization problem. 

Specifically, let be the set of L x L p.s.d. matrices and d be the set of diagonal matrices. Define 
$){Dc, Sy c ) as the set of all BT-achievable distortion matrices that satisfy the distortion constraints, and 
^(T,y c ) as the set of all possible diagonal covariance matrices Sjv £ , i.e., 
A 



2>(Dc,Z Yc ] 



G R Lxi : \D 



3,3 



Dj,\/j G C, and D 1 - E Y j G fl d|, 



^(£yj = {S G @>- nd : S t £y £ } 



(19) 
(20) 



Wang ef a/.'s result (6J is summarized in the following theorem. 

Theorem 1 (7|6|/)." If for some D G &(Dc,^y c ) an d G =^(Sy £ ), there exists a diagonal matrix 
fl = diag(-7Ti, ...,7tl) such that 



£>(n - D~ l + D'^D' 1 + - T.y^D-^D 



(21) 
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is a p.s.d. matrix with the same diagonal elements as those of (D 1 + H N — £y*) 1 , then the BT 
sum-rate bound is tight, i.e., 

R sum (X Yc ,D c ) = RfT m (Xy c ,D c ). (22) 

Using a different technique, sum-rate tightness for a special bi-eigen equal-variance with equal dis- 
tortion class of MT problems was proved by Yang and Xiong 0. That is, (031 ) holds for any £y £ € B 
and D c = {D,D,...,D) T for some D > 0, where B denotes the set of all L x L p.s.d. matrices with 
two distinct eigenvalues and equal diagonal elements. 

III. The two-terminal source coding problem with a matrix-distortion constraint 

In order to go beyond Wang et a/.'s sufficient condition [§), which assumes independent observation 
noises as seen in (fT8l) and is derived using classical Gaussian rate-distortion function, in this paper we 
allow 2x2 block-correlation among the observation noises. Consequently, the derivation of the new 
lower bound requires us to consider a variant of the two-terminal source coding problem where the two 
individual distortion constraints are replaced by a 2 x 2 matrix-distortion constraint. Although the original 
quadratic Gaussian two-terminal source coding problem is completely solved O, Q, due to the different 
distortion constraints, the exact achievable rate region for the manix-distortion constrained two-terminal 
problem is still unknown. In this section, we derive a lower bound on the sum-rate of the matrix-distortion 
constrained two-terminal problem, which serves as the key to our main results given in the next section. 

Assume that length-n blocks of Gaussian sources Y\ and Y2 are separated compressed at the two 
encoders, while the decoder tries to reconstruct Y c such that 



1 n 

limsup -Vfibi - Yc,i)(Yc,i - Y C , 
n^oo n f-f L 



-< D 



(23) 



i=l 

where A -< B means B — A is a p.s.d. matrix, and denote the minimum sum-rate of such a problem as 
i? sum (£y c , D). Compared to the original quadratic Gaussian two-terminal source coding problem with 
individual distortion constraints, we have 

D 1 6y/DTD~ 2 

Although Wagner et al.'s paper Q focused on the original quadratic Gaussian two-terminal source 
coding problem, their converse proof has already explored the relationship in (124b to some extent, and 
provided a composite lower bound on the sum-rate of the two-terminal source coding problem with 



Rsum{^Yc, (Di, D 2 ) ) = inf R surn Sy, 

0e[-i,i] 



c 1 



(24) 
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matrix-distortion constraint, namely, 

R sum (T, Yi .,D) > meix{R COO p(Y,Y c ,D),R l j i (Y,Y c ,D)\, 



(25) 



where 



Rcoop(^Y £ ,D) 



2 l0g W 

r.T ; 



R^y^D) = Rzr^ifi 1 Dp), 

jj, = (y/D2,y/Di) T , and Rj: Yc ,^(d) denotes the minimum sum-rate of the ^-sum problem with target 
distortion d. 

We now give the exact form of a new lower bound that is inspired by Wang et al.'s work (6[ and 
partially tighter than Wagner et al.'s bound in ( [251 . Note that there is no loss in assuming that the 
correlation coefficient p between Y\ and Y 2 is non-negative. 

Lemma 2: For any pair of 2 x 2 matrices 



D 



ap i pcr Yl CTY 2 
pa Yl cr Y2 <? Y 



such that 



it holds that 



p > 0, and D ^ Ey c , 



Rsum{^Y c ,D) > R sum (E Yi ., D) 



max 



where 



R^Y C ,D) 



Rl b (Z Yc ,D) 



R^ Yc ,D) 6<9 
R lb (X Yc ,D) 6>9 



1 viv 2 (viV2(l - p 2 ) + 2p{\ + 6)) 

2 g (i + ey 



1 



log 



v(vi(i - p 2 ) 



2\2 



2 b (l-0)2( UlU2 (l -p2) + 2p (l + 9))' 



with v\ = -A=, v 2 



ID-. 



■-, and 



a Vvivji 1 - p 2 ) 2 + V - ^2(1 - p 2 

2~P 



(26) 



(27) 



(28) 



(29) 



(30) 



(31) 
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Particularly, if 6 < 6, the lower bound is tight, i.e., R sum (Y> Yc , D) = R sum (T, Yc , D). 

Proof: See Appendix A. ■ 
Note that unlike the original two-terminal problem, the new lower bound R sum (Y, Yc , D) does not 
always meet the BT upper bound, which is given by 

R?J m (Z Yc ,D) = nmx{R lb (^ Y „D),R ll ^ Y£ ,D)} 

' R^ Yc ,D) 6<6 
R ub (H Yc ,D) 6>9 
with 

R ^ Yc , D) _ i log ^Ml_^_Mi^)). (33) 

Obviously, if 9 > 9, the two bounds do not coincide, and we can easily compute the gap between them 
as 



= R ub (Y, Yc ,D)-R lb (ll Yc ,D) 

1 , {viV2{l - P 2 ) - 2 P (1 - 9)){v 1 v 2 (l - p 2 ) + 2p(l + 9J) 

2 10g v 2 v 2 (l-p 2 ) 2 ' { 

To evaluate the maximum value of R^ um {Ti Yc , D), we compute the feasible range of 9, which i 

constrained by the assumption D ^ $]y £ , and given by 9 G (6, 9) with 

9 = max -yj (vf - l)(vf - 1) - p«i« 2 | , 



min|l,^(^-l)(^-l) + p^ 2 |. (35) 

Now due to the assumption that p > 0, R^ um (Y] Yc ,D) is monotone increasing in 9 in the range (9,6). 
Hence 

sup Rf um (T, Yc ,D) = limRf um (E Y/ ,,D) 
6e(§,e) e ^ e 

< l^Rt,m(^Yc,D) 
o — y i 

ilog(l + t P 9 , V (36) 



2 \ fl^2(l - P 2 ) J ' 
We thus conclude that although the lower bound R sum (Y; YL ,D) is not always tight, the gap to the upper 
bound RfJ m (Y, Yc ,D) cannot exceed a certain threshold that depends only on v\, v 2 , and p. 
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On the other hand, if we calculate the improvement from Wagner et al. 's lower bound (1251 ) to our new 

one Rsum(J^Y c , D) with 9 G (9,0), we obtain 



RsumC^Yc D) - max | Rcoop (^Y c , D) , Rp ,D)j 



77 lo g 



( Vl v 2 (l + 0)(1 



(37) 



2"~ a (l-0)(^ 2 (l-p2) + 2 p(l + 0))' 
which obviously goes to infinity as — > 1, this means that the improvement can be infinitely large for 
any value of v\, v 2 , and p such that 9 defined in 05l ) equals to one. 

A comparison among Wagner's lower bound 0, our partially improved lower bound, and the BT 
upper bound with o-^ = \ = 1, p = 0.9, L>i = 0.1, D 2 = 0.05 is shown in Fig. [3] We can clearly 
observe that the gap from our new lower bound to the BT upper bound is much smaller than that to the 
lower bound in |5). 
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Fig. 3. Comparison among Wagner's lower bound (5), our partially improved lower bound, and the BT upper bound. 
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IV. Main results 

A. Definitions and preliminaries 

Before stating our main results, we need to give some definitions and review the subgradient-based 
KKT condition. 

Let 7r = {7Ti, ...,7Tl} be a permutation of C, and nr be the corresponding L x L permutation matrix 
such that w£ = tt. We say an L x L matrix £ is block-diagonal if it is symmetric and can be 
written as 



ai,i «i,2 
«i,2 0,2,2 



03,3 03,4 
034 044 

























a 2 K-i,2K~i a 2 K-\,2K ... 

a 2 K-i,2i< a 2 K,2K ... 

a 2K +i ••• 

... a L _i 

... a L 

and denote Tk (tt) as the set of all block-diagonal matrices. Equivalently, £ G Tk(tt) if and only 
if S = E T and 

















w T , (38) 



S^,^, = if < 



(39) 



i,j G {1, 2, 2K] such that [§] / [§] 
i,j G {2if + 1, 2if + 2, ...,L} such that j 
i G {2K + 1,2K + 2, L} and j G {1, 2, 2K} 
i G {1, 2, 2ET} and j G {2K + 1, 2K + 2, ...,£} 
Comparing (I38T ) and (fT8l ). it is clear that all diagonal matrices are also tt^ k ' block-diagonal, but the 
converse is not true for K > 1, i.e., 



<d C T^(7r) for 1 < K < [— J and any permutation 7r. 
Consequently, if we define 

^<o(EyJ = {SG^nT^(vr):S^Sy,}, 
and compare with .jV{T,y c ) defined in (|20l ), it holds that 



(40) 



(41) 



(42) 
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for any < K < [-§J and permutation ir, where I denotes the identity permutation that maps £ to itself. 

For a set of L Gaussian sources Yc and a Stv £ £ T#(7r) such that Sjv c ^ Sy c , let M = rank(Ey. — 
S ) and the singular value decomposition of £ y. — Sat c be 

Sy £ -Sjv £ =T T diag(a 2 Xi ,a 2 X2 ,...,a 2 XM ,0,...,0)T. (43) 

Then define S Xai = diagOj^, ct Xm ), H = T M>C , and let 

X M ± AY C + Zc, (44) 

with Zc ~ A/"(0, £?) independent of Yc, where 

A = ^x M HH Yc , 

B = X Xm -X Xm HX-Ih t X Xm . (45) 

It is trivial to verify that the M Gaussian remote sources X_m ~ M(0, ^x M ) satisfy 

Y c = H T X M +N C , (46) 

with the L observation noises Nc ~ A/"(0, Sjv £ ) independent of X^j. 

Next, we briefly review the subgradient-based KKT conditions for non-differentiable convex optimiza- 
tion problems. The original KKT condition is a necessary condition for global optimality in a convex 
optimization problem with differentiable objective function and equality/inequality constraints. However, 
when dealing with non-differentiable convex optimization problems, subgradient-based KKT condition 
has to be used instead. We call g a subgradient ifTOl of a non-differentiable scalar-valued vector function 
/ at point x, if 

f(y) > f(x) + g T (y - x) for all y. (47) 

In particular, if / = max{/i,/2} with f\ and f 2 being convex and differentiable such that fi(xo) = 
f2{xo), then the subgradients of / at xq form a line segment between Vfi(xo) and V/2(#o)- The set 
of all subgradients of a function / at some point x is called the subdifferential of / at x, and denoted 
as df(x). The subdifferential of R surn (T>Y c ,T) is given in the following lemma, with a detailed proof 
given in Appendix B. 

Lemma 3: Assume that £y c and D take forms of (l26l ) and d27l ). respectively, such that D ■< Ey £ . 
Then the subdifferential of _R sum (£y. , D) (as a function of D) at 



D = D 



D 1 6^/D^D~2 



(48) 
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is a line segment 

1 ^-1 



: a G [0, 1] V , 



£>i (a + (l-a)(2|fl|-l))«>/Dr^ 

(a + (l-a)(2|0| -l))sVC^ D 2 

with 9 denned in (f3TT > and s = sign(0). 

For a convex optimization problem with objective function /, inequality constraints gi < for j = 
1, ...,m and equality constraints /ij = for j = 1, the global optimal point x = x* must satisfy 

m I 
i=l 3=1 

3i(ac*) < 0,i = l,2,...,m, 
hj(x*) = 0,j = l,2,...,Z, 
Mi > 0,i = 1,2, ...,m, 
Vi9i(x*) = 0,i = 1,2, ...,m, 

for some //j's and A/s. 

£. A new sufficient condition for sum-rate tightness 

Now we are ready to state our main result on a new sufficient condition for the tightness of BT 
minimum sum-rate. Consider an MT source coding problem defined by Sy £ and Dc- Denote the BT 
minimum sum-rate as i?^ n (Sy £ , Dc), and assume that the optimal BT scheme achieves a distortion 
matrix D. The main result of this paper is given in the following theorem. 

Theorem 2: RfJ^nC^Y^, Dc) = R SU miJ^Yci Dc) if there exists a permutation ir, a ir( K ) block diagonal 
p.d. matrix Etv c such that T,n £ ^ Ey c , an L x L p.s.d. matrix Q, an L x L p.s.d. diagonal matrix n, 
and a set of K 2 x 2 p.s.d. matrices ®j, j G K, such that the following conditions are satisfied: 

bfu-D' 1 +D~\b~ 1 + -S- 1 )- 1 ^" 1 )^ = A -ft, (49) 



{A)J + 0,-8(^(S Ar£ )J,diag((r)J)J 9 O.Vje/C, (50) 

[A] = If] , k = 2K + l,...,L, (51) 



ntE^-ZT 1 ) = 0, (52) 

j ((S JV£ )J-(f)J) = 0,Vje/C, (53) 

— Dj) = 0,Vje/C, (54) 
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where (C)J denotes the 2x2 submatrix constructed from the (tt^-i, 7T2j)-th row and (7r2j_i,7T2j)-th 
column of C, and 

f £ (C^ + E^-S- 1 ) -1 . (55) 

Proof: To prove Theorem 12 we need the following two lemmas, whose proofs are given in 
Appendices C, and D, respectively. 

Lemma 4: For any random objects Y c and Xm> if 

cov(Y c \X M 

for some i,j £ £, then 

cov^lX^,^) 
for any L functions W c = {^{ n) (Yx),^ n) (Y 2 ), ...,^\y l )}. 

Lemma 5: For any pair (Xm,Yc) satisfying (|46"1 ) and any Dc, there exists a D € M LxL and a 

T = m T diag(r 1) ...,r i f ) 7 ir+ i,..., 7L )w G T^(vr) (58) 

such that 

diag(£>) < L> £ 

T ^ (U^ + E^-Ep*)" 1 , (59) 
and the sum-rate of the quadratic Gaussian L-terminal problem satisfies 

1 |E X I K 1 L 

- 9 log n77^T ri + S^m(Sy { , afc _ 1 „ 2fc} |^,r fc ) + - J] log 



= (56) 

»>3 



= (57) 

hi 



(60) 



where Sy {jr 1 7r2fc} |x jM denotes the conditional covariance matrix of (Y 7T2k _ 1 ,Y 7r2k ) T given Xj^, and A 
and £? are defined in (|45|) . 
Remarks: 

• Lemma|4]ensures that cov^^-X^ , W/;) in (1571) shares the same structure with Ejv £ = cov(Y _ £|.X" J vf } 
in (f56T >. which is assumed to be block-diagonal in this paper. Note that this property holds even for 
non-block-diagonal Ejy c 's. 
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This structural similarity between T,jy c = cov(Yc\X_m) an d cov (Yc\Xm, Wc) is a key to the 
proof of Lemma 5, since it restricts cov(Y c\X m, Wc), which equals to T in (I58T ). to be block- 
diagonal, and hence makes the lower bound (l60l ) much simpler. 



Now we proceed to the proof of Theorem 

Due to Lemma [2 to find the best lower bound on R sum (EY c > Ac)> we need to solve the following 
optimization problem for given (X^,Yc) an d Dc satisfying (l46l) . 



1 |Ey j ^ ^ (j 

Minimizing - log — — - + ^Rsum&Y^^X^Tk) + g £ log- 

' ' fe=l i=i^+l 



over 



I7t 



A r i, ...,rjf,72x + i, ...,7l 

subject to T ^ (E^ + D 1 - Ey])- 1 , 

-< £> r< Ey £ , 

[-D]jj < for any j G £, 

o h r fc h E^^vfc g /c, 

0<7fe<^ , fc = 2i^ + l,...,L, 

fc 

which is clearly convex. The Lagrangian is 

L = -^log\ADA T + B\ 

K L 

+ ^R SU m{^Y { ^ k _ 1 ,^ k} \X M ^k) ~ ^ XI lo * 
fc=l i=i^+l 

+tr(A((E^ + £> 1 - S^ 1 ) - T- 1 )) + tr(n(Sg - 

L 

+5>(e i (E^ - r ^)) + 5>cn i s i M i ), 

t=i j=i 

where A, fi, 6j, i £ fC, IT,, j G £ are p.s.d. matrices, and 25$ is the L x L single-entry matrix whose 
(i,i)-th element is one. 

Assume that the optimal BT scheme achieves a distortion matrix D, and T as defined in (1551 ), then 
by applying Lemma |3l we obtain the subgradient based KKT conditions at (D,T), which are 

b(n-D~ 1 + £T 1 (b~ 1 + Trf c -E£)- 1 D~ 1> )b = A-n, 

(A}J + j -s((E J v £ }J,diag((f)J)) 3 O.Vje/C, 

[ A l = [r] 
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n^yl-D' 1 ) = 0, 
e i ((E J v £ )J - (f )j) = o.vje/c, 
[n]^],,,- A) = o,Vie/c, 

where II, A, fi, and 0/s are the p.s.d. Lagrangian multipliers. Then Theorem [2] readily follows. ■ 

• Example 1: the block-degraded case 

All known cases of quadratic Gaussian MT source coding problems with tight sum-rate bound belong 
to the non-degraded subclass, where all target distortions are met with equalities (i.e., all distortion 
constraints are active |[TTlD in the optimal BT scheme. In this subsection, we first study a block-degraded 
case, and independently show sum-rate tightness in this case (under certain condition). Then we give a 
numerical example to confirm that the set of block-degraded case with tight sum-rate intersects with the 
one defined by the sufficient condition in Theorem |2 

Consider a special case of quadratic Gaussian MT source coding, where the vector source Yc and the 
target distortion vector Djr can be partitioned into K groups, namely, (Ys 1 , D$ 1 ) , (Y$ 2 , D$ 2 ),..., {Ys K , D$ K ) , 
and for any k G K., there exists an integer i(k) G S k , such that 

Yj = Y i{k) + Zj, and Dj > D i{k) + of,, Vj G S k , (61) 

where Zj ~ Af(0,a^ . ) with a z . > for j G <Sfc — {i(fe)} and a\ = is independent of Yj( fc ) and 
Zj's are mutually independent. Each Yu k \, k G K is called the group leader in Y$ h , and denote Ya: = 
C*i(i), *i(2)> ^i(fc)) T . ^ = (A(l)> A(2)> A(fc)) T - We say a pair (Sy £ , L> £ ) is block-degraded (BD) 
if they satisfy the above condition. The K components of Yjc are referred to as core sources while the 
other L — K as redundant sources. 

Equivalently, (Ey^Ac) is BD if there exists a partition T 3 = {Sk : G /C} of £ and another pair 
(Ey , such that 

Ey. = GpSy^Gp + E^ £ , (62) 
= D k ,VkeK, (63) 
£>j > A + [EzJij,Vj G 5 fc - {i(fc)} and A; G /C, (64) 

where is an L x A' matrix whose (j, i(fc))-th element is one for all j G 5fc, k E K. with the rest 
being zero, and T,z c is a diagonal matrix whose diagonal elements are positive with exceptions that 
[£>Zc]i(k),i(k) = 0- Then an L-terminal quadratic Gaussian MT source coding problem with a BD pair 
(Ey £ ,Z?£) automatically induces a A-terminal source coding problem defined by the pair (Ey , At)- 
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Consider a BD pair (Sy c ,Z>£) with partition V = {Sk : k £ /C} and (Ey ,Djc,T,z c ) satisfying (l62l l- 
64b . We say a matrix A is "P-block-diagonal if [Ajjj = for any i £ <Sfc,j £ 5; with k, I G /C, A; 7^ Z, 



and denote dp as the set of all "P-block-diagonal matrices. For two L x L matrices A and £>, we write 

V 

A = B if = j for any i,j S 5fc with some k € /C. 

We claim that for a BD pair (Ey c , D/;), tightness of the BT sum-rate bound in the induced A'-terminal 
quadratic Gaussian MT source coding problem implies tightness of the same bound in the original L- 
terminal problem, which is stated in the following lemma, whose proof is given in Appendix E. 

Lemma 6: For any BD pair (Sy £ , Dc), if the BT minimum sum-rate is tight for the induced A'-terminal 
source coding problem, i.e., 

Rsum^Y^Djc) = flf™(%,^)) (65) 
then it must also be tight for the original MT source coding problem defined by {T,y c ,Dc), i-e-, 

Remarks: 

• Although Wang et al. 's sufficient condition for sum-rate tightness does not include any degraded 
case, one can easily use Lemma [6] to generate a BD example with tight sum-rate bound. In fact, 
with slight modifications (with details omitted), Wang et at 's proof can also be generalized to 
directly show sum-rate tightness for such BD cases without explicitly using Lemma [6] 

• We note that Lemma [6] only guarantees the sum-rate tightness of a subset of the BD subclass of 
quadratic Gaussian MT source coding problems. Moreover, this subset intersects with the one defined 
by the sufficient condtion in Theorem |2 as shown in the following numerical example. 

A specific numerical example that satisfies the requirements in both Theorem [2] and Lemma [6] is as 
follows. Let L = 4, 

r 1.0000 0.9000 0.8000 0.8000 
0.9000 1.0000 0.7000 0.7000 
0.8000 0.7000 1.0000 1.0000 
l 0.8000 0.7000 1.0000 1.1000 

and 



(66) 



(0.3760,0.35,0.3,0.5) 



T 



(67) 
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D 



(68) 



The optimal BT distortion matrix is 

f 0.3760 0.2740 0.1818 0.1818 
0.2740 0.3500 0.1231 0.1231 
0.1818 0.1231 0.3000 0.3000 
0.1818 0.1231 0.3000 0.4000 
hence this example is degraded since = 0.5 is not achieved with equality in the optimal BT distortion 
matrix D. 

We first verify that this example satisfies the sufficient condition in Theorem [2] Let it = {1,2,3,4} 
and 

f 0.2942 0.2852 

0.2852 0.4535 

0.0923 



0.1923 

be a tt^ k ' p.d. block diagonal matrix with K = 1. Then M = 4, 

3.1162 

0.0923 

0.0377 





Ex, 



H 



Now the following p.s.d. matrices 



-0.4712 


0.5417 
-0.6961 





-0.4130 


0.5619 
0.7167 



0.0061 

-0.5511 

0.7071 
-0.4421 

0.0290 



-0.5511 
-0.7071 
-0.4421 
0.0290 



0.2248 0.2489 0.0967 0.0967 

0.2489 0.2791 0.1075 0.1075 

0.0967 0.1075 0.0783 

0.0967 0.1075 0.1923 



ft 
















































0.1000 



(69) 



(70) 



(71) 



(72) 
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0! 



n 



o o 



1.0377 

1.8957 

2.6331 





(73) 



(74) 



(75) 



0.2248 0.1753 

0.1753 0.2791 

0.0783 

0.1923 

satisfy all the KKT conditions. Note that T in (1751 ) has the same structure as T*n c in (|69l ), which is 
consistent with Lemma 01 In addition, S(Xy c ,Z)£) is a line segment 



S(Sy £5J D £ )} 



a 



0.2248 0.2505 
0.2505 0.2791 



+ (l-a) 



0.2248 0.1001 
0.1001 0.2791 



: a £ [0, 1] > . (76) 



On the other hand, it is easy to verify that (T,y c ,Dc) is a BD pair with 

V = {{1},{2},{3,4}}, 

1.0000 0.9000 0.8000 

0.9000 1.0000 0.7000 

0.8000 0.7000 1.0000 

E Z£ = diag(0,0,0,0.1), 

D K = (0.3760, 0.35, 0.3) T , 

and the induced three-terminal quadratic Gaussian MT source coding problem defined by (Sy • , Dc) has 
a tight sum-rate bound due to Theorem [2] Hence we conclude that the above four-terminal numerical 
example of quadratic Gaussian MT source coding problem also satisfies the simple sufficient condition 
in Lemma [6l 

V. A SIMPLIFIED SUFFICIENT CONDITION 

Although the sufficient condition given in Theorem [2] is more inclusive than that in [6), it is rather 
complicated and hard to verify. However, in the non-degraded case where the optimal BT scheme 
quantizes every source, and achieves all L target distortions with equalities, the sufficient condition 
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in Theorem 2 can be further simplified. Note that the non-degraded case is of special interest since all 
the previously known quadratic Gaussian MT source coding problems with tight sum-rate bound belong 
to this case. 

Corollary 1: For an MT source coding problem defined by Ey c and Dc, if the optimal BT dis- 
tortion matrix D satisfies diag(.D) = Dc and D 1 — Ey* is a p.d. matrix, then Rf^ m {YjY L , Dc) = 
Rsum(£>Y £ , D c) if there exists a permutation it and a 7r( A ) block diagonal p.d. matrix Etv £ such that 

^N c ^ Ey c , 

A ^ 



\ = b(n-b ' + b \b 1 + Y\ N \-y,ylr 1 b iy jb 

is a p.s.d. matrix, and 



sign([f 



•T2fc-l,5T2fc. 



j. [a; 



^2k-l,^2k 



> 2 



[r] 



•T2(s-l,T2fc 



[r] M 



is satisfied for all k E K, where T is defined in (1551 ) and 

A 



n^diagfCDO.D)- 1 ^ 



(77) 



(78) 



(79) 



with denoting Hadamard product (entrywise product). 

Proof: First, due to the assumption that D 1 — Ey 1 >- 0, (l52l) implies that f2 = 0, which, combined 



with d49l ), directly leads to (I77T ). On the other hand, D — Ey >~ also ensures that 



D 1 + 



hence (1531 ) is true if and only if = for all j E K. 
Now d50l) becomes 



< E 



(80) 



(A)J-S((E JV JJ,diag((f)J)) 9 0,ViG/C, 



(81) 

then due to the fact that all 2 x 2 matrices in 8 ^(Eat c )J, diag((r)J)J have the same diagonal elements 
as those of (r)J, we know that 



[A] 



[f] 



, y k = 1,2, ...,2K. 



(82) 
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Hence by combining (1511 ) and (1821 . we obtain 

diag(A) 

o dia g (^(n - d 1 + D~\b~ l + - s^ 1 )- 1 ^ 1 )^) 

diag(Z>nZ>) 



diag(f) 



(I? f>)diag(n) 
diag(n) 



diag(£>) 
[£]M, V i G £ 
diag(D) = D c 
(D D)~ 1 Dc, 



(83) 



and ( 1791 ) is proved. 

Finally, d82l holds if there exists an a £ [0, 1] such that 



[ A ] 



■T2fc — 1,^2*: 



a + (l-a)(2 



sign([rl ) A /[fl 



[r] [ f ] 



J 7T2fc,7T2fc 



Now (1841 ) is equivalent to 



sign^fl J.fAl < J\T] 



J 7r2fe,7r 2 fc 



(84) 



(85) 



1 1"2fc-l,1"2fc 



> 2 



[r] -a/C 



1 7T2fe-l,7r2fe- 



and sign( [f 1 ) • [A 

where (l85T ) is automatically satisfied since 

[Al = ff] , \A) = [fl , and (A)" >- 0. 

L J 7T2fc-l,7r2fe-l L J 7r 2 fc - 1 ,TT 2 k - 1 L J 7I"2fc ,1~2fc L -I 7T2fc ,7T2fc 1 'J 

Hence (1781) must hold. 



ff] , (86) 



(87) 



• Example 2: the block-circulant case 

We study a special class of quadratic Gaussian MT source coding problem named the block-circulant 
case. 

Let L = 2m be an even number, and assume that the source covariance matrix Sy c is block-circulant, 
i.e., it is of the form 

B\ B 2 £?3 ... B m 
B m B\ B2 ... 5 m -i 



B 2 B 3 £? 4 



B1 
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B, 



(88) 



where Bi = B m+ 2-i for i = 2, 3, m are p.d. symmetric 2x2 blocks of the form 

Denote Cl as the set of all L x L block-circulant matrices. We state several important properties of 
block-circulant matrices. 

• Any S G Cl can be diagonalized by 

A 



G, 



F m ®F 2 



(89) 



with <g) denoting Kronecker product, and F m being the m x m real Fourier matrix Q (which is 



rp 

orthogonal with F m F m = I m ). For example, when L = 6, 



G 



<■> 






0.5000 
-0.5000 
-0.5000 

0.5000 



0.5774 


0.5774 


0.5774 


-0.5774 


0.2887 


-0.2887 


0.2887 


0.2887 


0.2887 


-0.2887 


0.2887 


0.2887 



.(90) 



0.4082 0.4082 

0.4082 -0.4082 

0.4082 0.4082 0.5000 

0.4082 -0.4082 0.5000 

0.4082 0.4082 -0.5000 

0.4082 -0.4082 -0.5000 

• Cl is a ring under matrix addition and multiplication. In particular, Cl is closed under the following 
operation 

A*B = A-A(A + BY 1 A = B-B(A + B) 1 B £ Cl, for any A, B G C L -(91) 

• For any A G Cl, there are 2 • \^^-\ degrees of freedom in the L eigenvalues of A, with \x\ 
denoting the smallest integer larger than x. 

We say a quadratic Gaussian MT source coding problem belongs to the block-circulant case if the 
source covariance matrix is block-circulant and all the target distortions are equal, i.e., Sy^ G Cl and 
DjC = D ■ 1. An important fact for this special case, which follows directly from the properties of 
block-circulant matrices, is that the optimal BT distortion matrix can be expressed analytically with 



D 



where q satisfies 



1 

J_ , i 

i=l A« ~ q 

with Aj, i G C being the L eigenvalues of Sy £ . 



LD, 



(92) 



(93) 
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Now we are ready to investigate the tightness condition provided by Wang et al. (6l for this block- 
circulant case, which is given in the following lemma, the proof is detailed in Appendix F. 

Lemma 7: For any block-circulant quadratic Gaussian MT source coding problem, Wang et a/.'s 
tightness condition [6, Lemma 4] for the sum-rate bound to be tight is equivalent to 



i , ^-l 



diagl (D D)~ Dl I h D - D (D + X~ \ n I 



D 



(94) 



6 (Da 



(95) 



with D defined in d92| ) and \ m in being the smallest eigenvalue of £y c . 

With Lemma |7J one can easily test whether Wang et a/.'s tightness condition is satisfied by a block 
circulant case of quadratic Gaussian MT source coding problem. For example, let L = 4 and 

1.0000 0.5000 0.9750 0.4800 
0.5000 1.0000 0.4800 0.9750 
0.9750 0.4800 1.0000 0.5000 
0.4800 0.9750 0.5000 1.0000 
and Dc = 0.1362 • 1. Then the optimal BT distortion matrix is 

0.1362 0.0189 0.1142 0.0018 
0.0189 0.1362 0.0018 0.1142 
0.1142 0.0018 0.1362 0.0189 
0.0018 0.1142 0.0189 0.1362 
We first use Lemma [7] to test Wang et al. 's tightness condition, which is not satisfied since 

di&g^DQDj^Dl^j = 4.1631/ 4 

7.5599 5.4290 -3.6183 -5.7492 

5.4290 7.5599 -5.7492 -3.6183 

-3.6183 -5.7492 7.5599 5.4290 

-5.7492 -3.6183 5.4290 7.5599 



D 



(96) 



i / 



(97) 



However, it is easy to verify that this example does satisfy the condition given in Corollary \T\ since 
when 7r = {1, 2, 3, 4} and 

f 0.0250 0.0200 

0.0200 0.0250 

0.0250 0.0200 

0.0200 0.0250 



G T 2 (7r), 



(98) 
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f and A denned in (l55l ) and (1771 ) satisfy 

sign([f ] 2k -i,2k) ■ [A] 2fc _i, 2fc = 0.0219 

> 0.0171 = 2[f] 2(t _ lj2(t 

Remarks: 



[f] 2fe _i, 2fe _i[f] 2fe)2fe) k = l,2. (99) 



• Unlike the known cases with tight sum-rate bound including the two-terminal case 0, the positive- 
symmetric case Q, and the BEEV-ED case (7J, some of the block-circulant cases might not have 
a tight sum-rate bound if they do not satisfy the requirements in Corollary Q] 

• We pick the block-circulant case as an example mainly because of the nice properties in this case 
that enable us to analytically evaluate the sufficient condition in Theorem Q] without a full search 
over £jv c <= ^V(E Yc ). 

Example 3: another numerical example 

Now we give a general numerical example that satisfies the requirement of Corollary [TJ 
Let L = 3, 

1.0000 0.9500 0.7000 
E Yc = 0.9500 1.0000 0.6000 , (100) 
0.7000 0.6000 1.0000 



and 



D c = (0.4,0.45,0.3)^ 



(101) 



Let vr = {1,2,3} and 



-<Nr 








(102) 



0.4827 0.5074 
0.5074 0.6205 

0.0512 

be a p.d. block diagonal matrix with K = 1. 

Then the BT minimum sum-rate bound for the MT source coding problem defined by Sy £ and Dc is 
tight, since T and A defined in d55l ) and ( 1771 ) satisfy 

sign([f ]i, 2 ) • [A]i, 2 = 0.3596 

2[f ]i , - A/[f]l,l[f] 2 , 2 . 



> 0.2815 



We have shown that the sum-rate tightness in the above numerical example is ensured by Corollary 
[Q In addition, it can be verified numerically that it does not satisfy the tightness condition provided by 
Wang et al. 0. 
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VI. Conclusions 

We have provided a new sufficient condition for the BT sum-rate bound of quadratic Gaussian MT 
source coding problem to be tight. The matrix-distortion constrained two-terminal source coding problem 
was investigated with partially tighter sum-rate bound given. This result was then used to derive a new 
lower bound on the sum-rate of quadratic Gaussian L-terminal source coding problem, which was shown 
to coincide with the BT sum-rate bound under certain subgradient-based KKT conditions. To highlight 
the superior inclusiveness of our new condition, examples were shown to satisfy the tightness condition 
derived in this paper (while excluded from the so far best known tightness condition given by Wang et 
al. 0). 

We are currently investigating possible generalizations of techniques used in the current paper to allow 
3 x 3 (or even larger) blocks in the observation noise covariance matrix. 



Appendix A: Proof of Lemma [2] 



Proof: Before proving Lemma |2j we define an equivalent two-terminal problem, with 

1 6 



PV\V2 
,2 



and D 



1 



(103) 



PV\V2 t>2 

Then we need to prove R sum (E Yc , D) > R^(T,y c ,D) and R sv , m (T, Yc , D) > R lb (Y, Yc ,D). 
To prove Lemma |2j let 



where Z ~ AA(0,<r|) with a\ 



X = Y 1 + Y 2 + Z, 

Viv 2 {l-p 2 ) 



(104) 



Then the variance of X can be computed as a 



x 



(Vl+V2p)(V2+VlP) 
P 



, and it can be easily verified that 

Y C = [ai,a 2 ] T ■X+[N 1 ,N 2 ] T , 



(105) 



with a\ ■ 

v 2 2 vi(l-p 2 ) 
V1+V2P 



VlP 

V2+VIP 



, OL2 



V2P 



<t„, [JVi.JVjF ~ Ar(0,diag(4_,4 )), and a 



v 2 V2(l~p 2 ) 2 
v 2 +v ± p ' TV, 



Moreover, any scheme that achieves a distortion matrix D on Yc must be able to achieve a 



distortion of [1 1] • D ■ [1 l} 1 + a 2 z on X 
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Hence 



H(W C 



I(Y C ,X;W C ) 



I(X;W c ) + J2l(Yi;Wi\X) 

i=l 

2 

h{X) - h{X\W c ) + h (Yi\X) - h(Yi- Wi\X) 



(106) 



i=l 



. n 

> 7T lo g 



cr 



2 6 [1 1] • D • [1 If + a| 2 



7i72 



(107) 



n , a v n , 

> — log — 1 — log - 

2 9x9flx viMi-?) 2 (u 2 + uip) (ui + w 2 p)7i72 ' 



2 + 26» + 

where (11061) uses the fact that Wj ->• IT 1 -+ X ->■ (K- 1 , W}) form a Markov chain for any i, j £ {1, 2} 
and z 7^ 7, in d 1071 ) we define ji = ^ X)j=i var (^ijl^ij ^) an( l use tne f act that Gaussian random 
variables maximize entropy over those with a fixed variance. 

On the other hand, due to J6J Lemma 1], we known that ~ X^ILi cov (^£,}|Ai, Wc) = diag(7i,72). 

Then [6, Lemma 3] implies that 

1 n -l 

-^covOrofoWc) 1 (d^ + E^-E^) , withS^ = (diag(4 i ,4 2 )), (108) 



8=1 



i.e., 



diag(7i,7 2 ) ^ 



+ 



uiv 2 (i - p 2 ) 



l l 
l l 



which can be combined with (11071 ) to form a semi-definite optimization problem that minimizes 

^(71,72) = 7: log— — 
2 7172 

over 71 and 72 subject to 



0(7l>72) 

The Lagrangian is 



+ 



viv 2 (l - p 2 ) 



1 1 
1 1 



diag(7f i , 7 - i ) ±0. 



IL(7i,7 2 ) = ^(71,72) + tr(A£7(7i,7 2 )J, 
where A is a positive semi-definite matrix. Then the KKT condition is given by 

V 7 X( 7l ,7 2 ) = 0, i = l,2, 

0(71,72) -< 0, 

AS (71, 72) = 0. 



(109) 

(110) 

(HI) 
(112) 

(113) 
(114) 
(115) 
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Solving the (11131 ) and (II 151 ). we get two sets of solutions, namely, 

71 = 1-0, 

72 = 1-0, 

A = IZI 



1 -1 
-1 1 



(116) 



and 



7i 

72 

A 



v lV2 (l- p 2 )(l + 0) 
^ 2 (l-p 2 ) + 2p(l + 0) ; 

v lV2 {i- P 2 ){i + e) 
Vl v 2 {i - p 2 ) + 2 P {\ + ey 

v lV2 (i - p 2 )(i + e) 
viv 2 (i- p 2 ) + 2 P {i + e) 



i i 
i i 



(117) 



Then it is easy to verify that the first set of solution satisfies (II 141 ) if 9 > 9, while the second set of 
solution satisfies (11141 ) if 9 < 6. Hence the optimal solutions of 7! and 72 are 

^2(i-p 2 )(i+e) a < 5 



7i = 72 



v 1 v 2 (i-p 2 )+2 P (i+e) 



(118) 



i-e e>9 

V 

which directly lead to d29l ). 

To prove tightness of the lower bound R sum (T,Y c , D) when 9 < 9, we construct a BT scheme with 
distortion matrix 



D 



(Sy 1 + diag(?i,? 2 )' 



i\-i 



(i+e)(t. 1 t. 2 (i-p 2 )+p(i+6>)) 

Ki) 2 (l-p 2 )+2p(l+0)) 

p(i+e) 2 
{v 1 v 2 (i~p 2 )+2p(i+e)) 



p(i+e) 2 

(^■!;2(l-p 2 )+2p(l+6»)) 
(l+6))(t, 1 t, 2 (l-p 2 )+p(l+6')) 
(« 1 i) 2 (l-p 2 )+2p(l+6»)) 



and sum-rate 



1, |£yj 
- log J — ^ 

2 S |U| 



1 v 2 v 2 (l -p 2 ) 

2 s Wi+0) 2 (i-p 2 ) 

{v 1 v 2 {i- P 2 )+2p{i+e)) 



(119) 



where 



qi 



(12 



v 2 v 2 (l-p 2 )(l + 



vfv 2 {\ 



(v 2 - p Vl )(l + 9)' 



v 1 v 2 (l-p 2 )(l + 



v x vl{\- p 2 )-(vx- pv 2 ){\ + 9)' 
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Then tightness is proved by verifying 



D-D 



P(l ~ g) ~ VlV20(l ~ P 2 ) 

{v±v 2 {l-p 2 ) + 2p{l + d)) 
h 0, 



1 -1 
-1 1 



(120) 



where the last matrix inequality is due to the facts that fi(9) = (viv 2 (l — p 2 ) + 2p(l + 9)) > 0, 
h{9) = — 2 ) — V\V 2 0{1 — p 2 ) is monotone decreasing in the range 9 G [—1,0), /2(d) = 0, and the 
assumption that 9 < 9. ■ 

Appendix B: Proof of Lemma [3] 

Proof: First, due to the assumption that D 1 — Sy 1 is a p.s.d. diagonal matrix, we must have 

^/l-2p2 +p 4 +4p 2 d 2 d 2_ (1 ^ p 2 ) 



2p dl d 2 — 

Vl-2p2+p 4 +4p^dj-(l~p 2 ) 



(121) 



with d\ = \fD\ and c?2 = V^2- Now since 

Rsumi^Yc, D) = max{i? /6 (Sy £ , J D),ii At (Sy c ,Z))} : 



we compute 



V D R lb (E Y z,D) \ D=£j 
VdR^y c ,D) \ D=f) 



K ■ 



x ■ 



J_ s(l-2|fl|) 

1 a 

Di VdTd^ 

s 1 



- \ZDxD-2 D 2 



(122) 



where 



p 4 - 2d l d 2 p* - 2p 2 + Ap 2 djd 2 + 2did 2/? + 1 _ P 2 + 2d 1 d2p-l j r _ 2p2 + p4 + 4p2d 2 d 2 ; 



2(1 -p 2 ) 2 



2{l-p 2 ) 2 



X 



P * + 2d2p 3 d 1 +4p 2 d 2 d 2 -2p 2 -2d2pd 1 + l 2d l d 2P -l + p 2 f AjAftos 
2(1 - p 2 ) 2 + 2{l-p 2 ) 2 V 1 ' 2 ? +P + 4 ^«) 



Finally, it is easy to verify that 



D-V D R lb (Z Yc ,D) I 



D=D 



-D-VdR^y^D) \ d=£} 
and Lemma [3] readily follows. 



D 



D 



Di 



s{\ - 2\9\)VD^D~2 
s{l-2\9\)^DTD~ 2 D 2 



D 1 sVD~[D~ 2 
sVD^ D 2 
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Appendix C: Proof of Lemma @] 



Proof: To prove LemmalU we need to use (6j Lemma 1], which is stated in the following proposition 
for the sake of completion. 

Proposition 1: For integers n, m and random variables X and oj, let X be a row vector of n 
independent drawings of X, and Y(uj) be any 1 x m vector of measurable functions of co. Then it 
holds that 



E 



X-E(X\u)) Y(u 



0, 



(124) 



Now (1561 ) and the definition of Wc imply that the Markov chains Wi — > Y i — > 1^ — > (Yj, Wj) and 
Yj — > Xm -> (Yi, W{) hold. Hence (I57T ) must hold since 



cov(r £ |X^,VF £ ) 



E 
E 
E 
0. 



(y< - TO) (^j " E(Yj\X M ,Wc)) : 

(Y, t - E(Yi\X M , Wi)) (Yj - E(Y j \X M ,W j )f 



(Yi - E(Yi\X M ,Yj, Wi, Wj)) (Yj - E(Yj\X M ,Wj)\ 



(125) 
(126) 
(127) 



where (11251 ) and (1126b are due to the above two Markov chains, and (11271 ) used Proposition Q] and the 



fact that [Yj - E(Yj\X M , Wj)) is a function of oj = (X M ,Yj, Wi, Wj). ■ 

Appendix D: Proof of Lemma [5] 

Proof: First, given £at c G T^(7r) and Sat c ^ Sy c , we can always apply (l43l) to find an M x L 
matrix H and (l44l) to construct M remote sources Xm such that (l46l ) holds. This implies that Sjv £ = 
cov(Y c\X m) £ ^A'(vr). Then we can apply Lemma HI and obtain that cov(l^£|X_A4, M 7 ^) £ T^(7r). 
Hence we can denote 



cov(Y c \X M ,W c ) G T^(tt) 



(128) 



which takes form of (|551 >- 

On the other hand, due to d46l ), we know that any scheme that achieves a distortion matrix of D on 
Yc must be able to achieve a distortion matrix of ADA T + B on X_m ■ 
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Similar to (11061 ). we write 

H{W C ) 
= I(Y c ,X;Wc) 

K L 

= /(X;W £ ) + ^/(r {7r2fc _ 1 ^ 2fc} ;^ {7r2fc _ 1 ^ 2fc} |X A ,)+ HY^W^Xm) (129) 

i=l i=K+l 
K 

= h(X) - HXlWti + YWi^u^W^^ylXM) 

i=l 

L 

+ Y (h(Y 7rt \X M )-h(Y ni ;W nt \X M )) (130) 

i=K+l 

1 IS I K i L a 2 



where (11311 ) comes from the assumption that the achieved distortion is no larger than D in the positive def- 
inite sense, and the definitions cov(Y {w2k li7T2k} \W {w2k _ u7r2k} , X M ) = T k and 7; = ± ^™=i var^jlWj, X). 
Now comparing d60l ) with dl31| ), we only need to show that 

I ( Y {*n-u*»}i W {*n-u*».}\ X M) > nR sum {E Y{ ^ kiw2k}lXM ,T k ) (132) 
holds for any k € 1C. 

Assume that (11321 ) does not hold for some k G /C, i.e., there exist encoders V^iLi and such that 

c °v( Y '{7r M _ 1 ,ir ! H k }|W{7r afc _ lj ir»} > -XM) = T k, 

I ( Y {7r 2k - 1 ,^ k y,W { ^ 2k _ 1 ^ 2k} \X M ) < nR sum {^ Yu2ki ^ k) \ XM ,T k ). (133) 
Then consider the matrix-distortion constrained two-terminal problem with sources 

Wi.*»> ~^(°' S ^- 1 ,^>I^m) (134) 

and target distortion matrix Y k . Now let 1^ be a length-n block of samples independently draw from 
X_\4 = AYc + Zc according to (l44l) . Also assume that Ijn is independent of the sources Y ^ 7T2k u7T2k y 
and available at both the encoders and the decoder. Let 

Y {K 2k -i,ir 2k } = ^{irafe-i,^} + H M,{n 2k - 1 ,w 2k } X M, (135) 



where is the M X L matrix satisfying (1461) . It is obvious that Y ^ n2kit7T2k y has a covariance matrix of 

(n) (n) 

Sy {it _ ^ 2fc} , hence we can blindly apply the same encoders V^Li and on r { 7r2A ,_ 1 , 7 r 2S ,} to generate 
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W{7rah_i,7r3k} before using Slepian-Wolf coding with decoder side information Xm> to achieve a final 
rate of 

H ( w {*»k-i,* ak }\ x M) = I ( Y {7T 2k ^ 1 ,7r 2k y,W {n2k _ u7r2k} \X M ) 

< nR sum (T, Y{ „ 2k _ i:ir2k} \x M ,Tk), (136) 

and a distortion matrix of = cov(Y i^ 2k _ 1 ^ 2k \\Wi 7r2k _ ljW2k \, Xm)> which contradicts with the defini- 
tion of Rgum^Y { „ 2fc i y \x M i Tfc). Then Lemma [5] follows from d 129b . (11321 ). and Lemma[2] ■ 

Appendix E: Proof of Lemma [6] 

Proof: First, it is obvious that i?^j(£y £ , Dc) = R^um{^Y K .^K)- Then assume that there is a 
sequence of schemes {{4>^\ • n e sucn tnat 

limsupV^ < R^P^Dk), (137) 

rwoc j( . c 

limsup -e\(Y u - Y M ) 2 ] < Dj, for any j G £. (138) 
Now consider another sequence of schemes {(</>^\ : n G N + } such that for any k G /C, 

= ( 139 ) 

4 n) (^i) = for any j G 5 fc - {i(k)}, (140) 

where 

= W m = <f>%(Y i{k) ), (141) 

^ = ^(Y.^ + Zj), (142) 

with Zj ~ A/"(0, cr| 3 ) being independent of Yc, 'W denotes Cartesian product, and 

4t)( W c) = 4t)( W c). (143) 

Then we must have 

Rsum{<t> { c ,4c) = Rsum^P^P), (144) 

^]hn8upR aum $c\$c) = limsup J R sum (0^ l) , ip^) 

n—>oo n— >oo 

< RfJ m ^Y K ,D K ), (145) 
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and 



limsup —E 

n— >oo Tl 



Yj ti -E{Y ifi \W c ) 



< 



j = i(k) for some k G K, 



D%{jt) + a\. < Dj j G Sk — {i(k)} for some k G /C 

Hence the sequence of schemes {(^^ ) : n G N + } achieves the distortion vector Dc and a 

sum-rate smaller than RfJ m {T, Y , Ac)- On the other hand, : n, G N + } is also an achiev- 

able sequence of schemes for the induced if -terminal problem, for which the BT sum-rate bound 
RfXn^Yc Dc) = Rf^ m {TiY K i Ac) i s known to be tight, leading to a contradiction. ■ 

Appendix F: Proof of Lemma [7] 

Proof: We only need to show that if 

^([DQ^^Dlj h D 1 — D ^(I) 1 + -1 — Ey^) _1 i) _1 
holds for some p.s.d. diagonal matrix = diag(/ii, [12, such that 

Sy £ h e, 

then (l94l must also hold. 



(146) 



(147) 



In fact, due to the symmetric properties of block-circulant matrices, it is easy to show that if both 
(11461 ) and (11471 ) hold for = diag(//i, fi2, •••,/■*£)> inen they must also hold for 







diagf/i f ( fej i), M<r(fc,2)i /^(fc+l,!)' M«r(fc+l,2)j /Ar(fc+m-l,l) 1 ^(fc+m-l^) J ! 



for any G {0, 1, m — 1}, as well as 







- diagf/i f ( fej2 ), M?(jfc,i)i /^(fc+1,2)! M?(fe+i,i)j •••> A 1 ? (fc+m-1,2) > /Ar(fc+m.-i,i)l : 
where <j(j, i) = 2 ■ (j mod m) + i Hence d94l must be true since 

dia g (( J D0 J Dr i m) b I ^[ J D~ 1 -^ 1 (£)~ 1 + (0ir 1 -^]r 1 ^ 1 " 

fc=l 

+1 E 1 - + (©I)" 1 - ^r 1 ^ -1 



(148) 



(149) 



k=l 



t ^ 1 -^ 1 (i>- 1 +(^E i+iE i 



^-1 



fe=i 



fe=i 



(150) 
(151) 
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where (11501 ) is due to the concavity of D 1 — D 1 {D 1 + 1 — ^ Y ]) l ^ * wrtri respect to 0, and 
(11511 ) uses the fact that 

sy £ y e{, s y£ y e* 

m 1 m 1 L 



fc=l fc=l 1=1 



1 L 

y /JMj < A m in- (152) 
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